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Abstract — The sum capacity of a class of discrete memoryless 
interference channels is determined. This class of channels is 
defined analogous to the Gaussian Z-interference channel with 
weak interference; as a result, the sum capacity is achieved by 
letting the transceiver pair subject to the interference commu- 
nicates at a rate such that its message can be decoded at the 
unintended receiver using single user detection. Moreover, this 
class of discrete memoryless interference channels is equivalent 
in capacity region to certain discrete degraded interference 
channels. This allows the construction of a capacity outer- 
bound using the capacity region of associated degraded broadcast 
channels. The same technique is then used to determine the sum 
capacity of the discrete memoryless interference channel with 
mixed interference. The above results allow one to determine sum 
capacities or capacity regions of several new discrete memoryless 
interference channels. 

I. Introduction 

The interference channel (IC) models the situation where 
the transmitters communicate with their intended receivers 
while generating interference to unintended receivers. Despite 
decades of intense research, the capacity region of IC remains 
unknown except for a few special cases. These include in- 
terference channels with strong and very strong interference 
[1|-[5|; classes of deterministic and semi-deterministic ICs 
EQ, Q; and classes of discrete degraded ICs @, 0. 

Parallel capacity results exist for the discrete memoryless 
IC (DMIC) and the Gaussian IC (GIC). Carleial first obtained 
capacity region for GIC with very strong interference [ 1|. This 
result was subsequently extended by Sato to that of DMICs 
with very strong interference. Note that the definition of DMIC 
with very strong interference can actually be broadened to 
be more consistent with its Gaussian counterpart [10]. Sato 
and Han and Kobayashi [4] independently established in 
1981 the capacity region of GIC with strong interference, 
where the capacity is the same as that of a compound multiple 
access channel. In |3| Sato also conjectured the conditions of 
DMICs under strong interfernce, which was eventually proved 
by Costa and El Gamal in 1987. 

While the capacity region for the general GIC remains 
unknown, there have been recent progress in characterizing 
the sum capacity of certain GICs, including: GICs with one- 
sided weak interference [11], noisy interference [ 12|-[ 14], and 
mixed interference [13]. This paper attempts to derive parallel 
sum capacity results for DMICs with weak one-sided and 
mixed inference. Our definitions of one-sided, weak, or mixed 



interference are motivated by properties associated with the 
corresponding Gaussian channels. Some of those definitions 
are intimately related to those introduced in [ 15 1 which studies 
the capacity region of the discrete memoryless Z-channel. 

The rest of the paper is organized as follows. Section [TT] 
presents the channel model and relevant previous results. 
Section [HI] defines DMICs with one-sided weak interference 
and derives their sum capacities. We refer to those DMICs with 
one-sided interference as DMZIC (i.e., discrete memoryless Z 
interference channel) for ease of presentation. The equivalence 
between the DMZIC with weak interference and the discrete 
degraded interference channel (DMDIC) is established which 
allows one to construct a capacity outer-bound for the DMZIC 
using the capacity region of the associated degraded broadcast 
channel. Section [IV] defines DMICs with mixed interference 
and derives the sum capapcity for this class of channels. 
Section [V] concludes this paper. 

II. Preliminaries 
A. Discrete Memoryless Interference Channels 

A DMIC is specified by its input alphabets X\ and X 2 , out- 
put alphabets y% and y 2 , and the channel transition matrices: 



p(yi\xix 2 ) = ^2 P(yiV2\xix 2 ) 

p(y2\xix 2 ) = ^2 p(yiy2\xix 2 ) 

The DMIC is said to be memoryless if 

n 

vh)\y 2 \x r {x 2 ) = Y[p(yiiy2i\xiix 2 i) 

2=1 



(1) 

(2) 



(3) 



A (n,2 nitl ,2 ni?2 ,Ai, A 2 ) code for a DMIC with inde- 
pendent information consists of two message sets M.\ = 
{1, 2, • • • , 2 nRl } and M 2 = {1, 2, • ■ ■ , 2 nRz } for senders 1 
and 2 respectively, two encoding functions: 

h-.Mi^X?, f 2 :M 2 ->X?, 
two decoding functions: 



and the average probabilities of error: 

Al= — , , ; ^ ^ Pr{v3l(y!) / Wl|Wl = IDl, W 2 = TO 2 }, 



A 2 = 



|Mi||M 2 | 
1 

!7Wi||7W 2 | 



w\ — 1 W2~l 
2 nR 1 2 "- R 2 

^ ^ Pr{y> 2 (y 2 ) / tu 2 |Wi = 14^2 = w 2 }- 

— 1 102 — 1 



A rate pair (iii, P 2 ) is said to be achievable for the DMZIC 
if and only if there exist a sequence of (2™ fll , 2"- R2 , n, Ai, A2) 
codes such that Ai, A2 — > as n —¥ 00. The capacity region of 
a DMZIC is defined as the closure of the set of all achievable 
rate pairs. 

B. Existing Results for GICs 

The received signals of a GIC in its standard form are 

Yi = Xi + y/aXs + Zi, (4) 
Y 2 = VbX 1 +X 2 + Z 2 , (5) 

where a and b are the channel coefficients corresponding to the 
interference links, Xi and Yi are the transmitted and received 
signals, and the channel input sequence Xn,Xi 2 , ■ ■ ■ , Xi n is 

n 

subject to the power constraint X?- < nPi, i = 1,2, Z\ 

i=i 

and Z2 are Gaussian noises with zero mean and unit variance, 
independent of X\,X 2 . 

Sason in ifTTl proved that the sum capacity for GICs with 
one-sided weak interference (a < 1 and b = 0) is 



forms a Markov chain, this DMIC is said to have one-sided 
interference. 

We refer to such DMIC as simply DMZIC. The definition is 
a natural extension of that for Gaussian ZIC where X 2 causes 
interference on Y\. From the definition, it follows that X\ and 
Y 2 are independent for all input distribution p(xi)p(x 2 ). 

To define DMZIC with weak interference, we first revisit 
some properties of Gaussian ZIC with weak interference. 
Similar to that established in [ 15 1, it is straightforward to show 
that a Gaussian ZIC with weak interference is equivalent in 
its capacity region to a degraded Gaussian ZIC satisfying the 
Markov chain 



X 2 -{X 1 ,Y 2 )~Y 1 . 



(8) 



This is referred in ifTBI as degraded Gaussian Z channel 
of type-I. This motivates us to define DMZIC with weak 
interference as follows. 

Definition 2: A DMZIC is said to have weak interference 
if the channel transition probability factorizes as 



p(ym\xix 2 ) =p(y2\x 2 )p'(y 1 \x 1 y 2 ), 



(9) 



Nl 



P 2 ) + ilog 



1 



Pi 



l + aP 2 



for some p'(yi \xiy 2 ), or, equivalently, the channel is stochas- 
tically degraded. 

In the absence of receiver cooperation, a stochastically 
degraded interference channel is equivalent in its capacity to a 
physically degraded interference channel. As such, we will as- 
sume in the following that the channel is physically degraded, 
i.e., the DMZIC admits the Markov chain X 2 - (X 1} Y2) - Yi. 
As a consequence, the following inequality holds 



Motahari and Khandani in 11131 established that the sum 
capacity for GICs with mixed interference (a < 1 and b > 1) 
is 



I(U;Y 3 ) >/(t/;Yi|Xi) 



(10) 



1 + 



Pi 



l + aP 2 



1 + 



bPi 
I + P2 



+ -log(l + P 2 ) 



for all input distributions p(xi)p(u)p(x 2 \u). 

The channel transition probability p(y\y 2 \x\x 2 ) becomes 



We attempt to extend these results to DMICs with appropri- 
ately defined one-sided weak interference and mixed interfer- 
ence. 

C. Useful Properties of Markov Chains 

The following properties of Markov chains are useful 
throughout the paper: 

. Decomposition: X - Y - ZW =$> X — Y — Z; 
. Weak Union: X — Y — ZW => X — YW - Z; 
. Contraction: [X — Y — Z) and (X — YZ — W) =4> 
X - Y - ZW. 

III. The DMZIC with Weak Interference 
A. Discrete Memoryless Z-Interference Channel 

Definition 1: For the DMIC defined in Section ITTAl if 

p{V2\X2) =p(y 2 \xix 2 ), (6) 

for all xi, x 2 , y 2 , or equivalently, 

X 1 - X 2 - Y 2 (7) 



P(yiy2\xix 2 ) = p{y 2 \xix 2 )p{y 1 \x 1 x 2 y 2 ) 
= p(y2\x 2 )p(yi\xiy 2 ). 



The above definition of weak interference leads to the 
following sum capacity result. 

Theorem 1: The sum capacity of a DMZIC with weak 
interference as defined above is 

C sum = max {/(X 1 ;y 1 )+7(X 2 ;y 2 )}. (11) 

p(xi)p(x 2 ) 

Proof: This sum rate is achieved by two receivers de- 
coding their own messages while treating any interference, if 
present, as noise. 
For the converse, 

n(Ri + R2) — ne 

( <I(X?;Yr) + I(X' 2 l ;Y 2 n ) 

71 



-H(y«|y 2 ,_1 A?) 



(c) ™ 



-H{Y 2l \Yr 1 X 2 i 



(d) < 



(H (Y u ) - H (Yii I xr KT 1 ) + / (Xjh ; | t/ 4 



1=1 

n 

= ^2(I(UiXH;Y u ) + I(X 2i ; Y M \Ui)) 

i=l 
n 

= £(I(Xu; Fh) + I(Ui- Y U \X U ) + I(X 2i ; Y 2i \Ui)) 

i—l 
(/) " 

< Yii) + /(Di; y«) + I{X 2i ; Y 2l \U l )) 

i=l 

= X)(/(Xx<; Hi) + /(KX2,; Y 2i )) 

i=l 
n 

^^2(I(Xu;Yu)+I(X 2i ;Y 2i )), 

where Ui = Y 2 ~ x f° r a ^ ( a ) f°ll° ws the Fano's In- 
equality, (&) is from the chain rule and the definition of 
mutual information, (c) is because of the fact that con- 
ditioning reduces entropy, and that Y<u is independent of 
any other random variables given Xu, (d) is due to the 
memoryless property of the channel and the fact that Yu 
is independent of any other random variables given Xu 
and Y 2l , then (X% >V Y U ) - (Xf -1 ,!^ -1 ) - Y^ 1 forms a 
Markov chain. By the weak union property, the Markov chain 
Y u - (Xf, Y 2 i_1 ) - Yi' 1 holds; (e) is because of the Markov 
chain (Xp 1 , X£ i+1 ) - (Xu, Y 2 _1 ) ~ Y u . The easiest way to 
prove it is using the Independence Graph. Alternatively, we 
first note that the Markov chain 

(XJ >X" i+1 ,Y 2 ) — (Xu, Y2j) — Yu 

holds, since given Xu and Yu, Yu is independent of 
X{ ,X™ i+ i,Y£ . By the weak union property, the follow- 
ing Markov chain is obtained: 

(Xi-\X? ii+1 )-(X u ,Yi)-Y u . 

Together with the Markov chain 

(XJ , X" i+1 ) - Xii - Y 2 

because of the independence between Y 2 " and X™, we get the 
Markov chain: 

(X\ ,X"j +1 ) - Xu - (Yu, Y 2 ) 

by the contraction property. Again, using the weak union 
property and then the decomposition property, we obtain the 
Markov chain 

(X\ ,X" i+1 ) - (Xii, 5^ ) — Yu 

as desired. Since U% and Xij are independent, then 
p(x\X 2 u) = p(x\)p(u, x 2 ), thus (/) comes from ([Toi l. Finally, 



(g) follows from the Markov chain Ui — X 2 i — Y" 2j ;. At last, 
by introducing a time-sharing random variable Q, one obtains 



R\ + i? 2 



< /(X i; Yi|Q) 

< 



I(X 2 ;Y 2 |Q)+e 



max {I(X 1 ;Y 1 )+I(X 2 ;Y 2 )} + e. 

p(xi)p(x 2 ) 



Remark 1: The Markov chain (O is a sufficient, but not 
necessary, condition for the mutual information condition 



/(X 2 ;Yi|Xi)</(X 2 ;Y 2 ) 



(12) 



for all product input distribution on X\ x X 2 . One can find 
examples such that the mutual information condition holds but 
the Markov chain is not valid. This is different from that of 
the Gaussian case; it can be shown that the coefficient a < 1 
in a Gaussian ZIC is a sufficient and necessary condition for 
(fT2l to hold. It is yet unknown if condition ( fT2l is sufficient 
for the sum capacity result (fTTT i to hold for DMZIC with weak 
interference. 

B. Capacity Outer-bound for DMZIC with Weak Interference 

For Gaussian ZICs with weak interference, Sato |2| ob- 
tained an outer-bound using the capacity region of a related 
Gaussian broadcast channel constructed due to the equivalence 
in capacity between a GZIC with weak interference and a 
degraded GIC. The same technique can be used to obtain a 
capacity outer-bound for DMZIC with weak interference, i.e., 
that satisfies the Markov chain X 2 — (Xi, Y%)— Y±. Specifically, 
for any such DMZIC with weak interference, one can find 
an equivalent (in capacity region) DMDIC whose capacity 
region is bounded by that of an associated degraded broadcast 
channel. 

Theorem 2: For a DMZIC that satisfies the Markov chain 
X 2 — X1Y2 — Yi, the capacity region is outer-bounded by 



TLoi 



U 

p(u)p(x 1 x 2 \u) 



Ra) 



Ri<I(U;Yi), 
R 2 <I(X 1 X 2 ;Y1\U) 



where U — X\X 2 — Y 2 — Y\ forms a Markov chain and \\U\\ = 
min{||3^il|, M^II, M-^xIl - 

Proof: Suppose that the DMZIC with weak interference 
has inputs and outputs X\, X 2 and Yi, Y 2 respectively. Let 
us denote by X[, X 2 and Y{, Y 2 the inputs and outputs of 
another DMIC. Set X{ = X x , X 2 = X 2 , and Y{ = Y\ but 
define Y 2 to be a bijection of Xi and Y 2 , denoted as Y 2 = 
/(Xi,Y 2 ). As the Markov chain (X[,X' 2 ) - Y 2 ' - Y{ holds, 
the DMIC specified by the input pair (X[, X 2 ), and the output 
pair (Y{, Y 2 ') is indeed a DMDIC. 

The proof that this DMDIC has the same capacity region 
as the specified DMZIC, and hence is outer-bounded by the 
associated broadcast channel follows in exactly the same 
fashion as Costa's proof for the Gaussian case JT6), hence 
is omitted here. ■ 

Remark 2: The output Y 2 need not necessarily be a bijection 
function of Xi and Y 2 ; instead, depending on the transition 
probability p(yi\xiy 2 ), other Y 2 can be constructed. However, 
the associated broadcast channels would have the same the 
capacity region. It will become clear in the following example. 



C. Numerical Example 

Example 1: Let H^H = ||;t 2 || = H^H = ||y a || = 2 and 
the channel transition probability be given by 

p{y\y2\xix 2 ) = p{y2\x 2 )p{yi\xxy 2 ), 

where p(y 2 \x 2 ) and p{yi\xiy 2 ) are specified in Table [I] 

TABLE I 

Channel Transition Probabilities 



p{y 2 \x 2 ) 


2/2 = 


2/2 = 1 


P(j/l|ziS/2) 


2/1 = 


2/1 = 1 


x 2 = 


.1 


.9 


xij/2 = 00 or 11 


.75 


.25 


X2 = 1 


.9 


.1 


£12/2 = 01 or 10 





1 



By Theorem Q] the sum capacity is 

C sum = max I(X 1 ;Y 1 ) + I(X 2 ;Y 2 ) 

p(xi)p(x 2 ) 

Moreover, one can construct y 2 ' as follows: 



.531. 



V - 

1 2 — 



0, if xxy 2 = 00 or 11, 



1, otherwise. 
Then p{y' 2 \xix 2 ) is given in Table ITT1 

TABLE II 



p(y^|a;iX2) 


2/2 = 


2/2 = 1 


X1X2 = 00 


.1 


.9 


XlX2 = 01 


.9 


.1 


XlX2 = 10 


.9 


.1 


X1X2 = 11 


.1 


.9 



Using Theorem [2] the capacity region of the DMZIC is 
outer-bounded by that of the associated DMDBC: 



Rod —{ IJ {RuBa) 

p{u)p(x 1 x 2 \u) 



Rx<I{U;Yx), 

R 2 < 7(XiX 2 ;y 2 '|LT) 



If one takes the bijection function to construct Y 2 \ it will lead 
to the same outer-bound. If we fix R 2 to be x, then 

maxi?i = max H(YA - H{Y X \U) 

R 2 =x H{YJ,\U)=x+h 2 (.l) 

< l0g(|^l|)-/T^ + /i2(.l)), 

where /t(') is a function defined by Witsenhausen and Wyner 
ifTTl . Fig. [T] depicts the new outer-bound specified by 

K' OB = {{Rx,R 2 )\Ri<\og\yx\- f T {x + h 2 {.l)),R 2 <x}. 

This new outer-bound significantly improves upon the follow- 
ing bound 

Ri < J(x i; yi|x 2 ), 

R 2 < I(X 2 ;Y 2 ), 
R1+R2 < I{X 1 -Y 1 )+I{X 2 -Y 2 ). 




0.05 0.1 0.15 0.2 0.25 0.3 0.35 



Fig. 1. Comparison of the outer-bounds. 



IV. The DMIC with Mixed Interference 

Definition 3: A DMIC is said to have mixed interference if 
it satisfies the Markov chain 



and 



X 2 -(X 1 ,Y 2 )-Yi 
J(Xi;Yi|X 2 ) <J(Xi;Y a \X a ) 



(13) 
(14) 



for all possible product distributions on X\ x X 2 . 
This definition is motivated by GIC with mixed interference, 
which can be shown to be equivalent in capacity region to 
a degraded GIC satisfying ( TT~3T > by setting p(yiy 2 \xix 2 ) = 
p(y 2 \xix 2 )p' (yi\xiy 2 ), where p'(yi\xiy 2 ) is normal distribu- 
tion with mean (1 — \/ab)xi + \fay 2 and variance 1 — a. The 
sum capacity for GIC with mixed interference was established 
in lfT3l . We obtain a parallel result for the DMIC with mixed 
interference as defined above. 

Theorem 3: The sum capacity of the DMIC with mixed 
interference satisfying the two conditions ( TOI ) and (fT4b is 



max {I(X 2 ; Y 2 \Xi) + min{/(Xi; Yi), I{Xu Y 2 )}} . 



(15) 



Proof: In order to achieve this sum rate, user 1 transmits 
its message at a rate such that both receivers can decode it 
by treating the signal from user 2 as noise; user 2 transmits 
at the interference-free rate since receiver 2 is able to subtract 
the interference from user X\. 

For the converse, we prove the following two sum rate 
bounds separately: 

n 

n(R 1 +R 2 ) < ^2l(XuX x ;Yai), (16) 

n 

n(R!+R 2 ) < ^/(X ll ;Y ll ) + /(X 2l ;F2 l |X 1 0. (17) 

i=l 

For ( fTol l. the derivation follows the same steps as Costa and 
El Gamal's result [5J- For ( fT7l ), we use similar techniques 
for establishing the sum capacity of the DMZIC with weak 
interference in Section [TTIJ First, notice that ( TO] ) implies 



7(C/ ; yi|Xi) < I(U;Y 2 \Xi) 



(18) 



for any U whose joint distribution with X\, X2, Y\, Y% is 



V. Conclusion 



p(u, asi, X2, 2/1,2/2) = p{u)p{x 1 x 2 \u)p(y 1 y 2 \x 1 x 2 ). (19) 
Then, 

n(Ri + R 2 ) — ne 
{ <I{X?-Y?)+I{X%-Y 2 n \X?) 

n 

-H(Y 2i \Yt X X?X?)) 

(h) 71 , 

< J2 - H(Y u \Yr X^Yt 1 ) + H{Y 2i \U i X li ) 

i=l 

-H(Y 2 i\X 2 iX li U i )) 

n 

= ^2(I(UiXu; Y u ) + I(X 2i ; Y 2i \UiX u )) 

1 = 1 

71 

= ^ (I(X U ; Y u ) + / {Ui ; Yu \X U ) + / (X 2l ■ Y 2i \ Ui X u ) ) 

i=l 
(c) n 

< ^2(I(Xu;Y u ) + I(Ui\ Y 2i \X li ) + I{X 2i - Y 2i \UiX u )) 

n 

( i ) ^(/(Xi i ;Fi i ) + 7(X 2i ;F 2 i|X li )), 

i=l 

where (a) is because of the independence between X™ and 
X2', (b) is from the fact that conditioning reduces entropy 
and Ui = {Xl^Xl^.Y*- 1 ); (c) is from ggj; and (d) 
is because the memoryless property of the channel and dl9l) . 
Finally, from ( [ToT l and ( fTTI i. we have 

i?i+7? 2 < max /(XuXajta), 

p(a; 1 )p(a;2) 

i?i+7? 2 < max HX^Y^ + HX^Y^Xi), 

p(x 1 )p(x 2 ) 

respectively. ■ 
We give the following example where the obtained sum 

capacity helps determine the capacity region of a DMIC. 
Example 2: Consider the following deterministic channel: 

Yi = X x -X 2 , 
Y 2 = X 1 ®X 2 , 

where the input and output alphabets X\, X2, D^i and 3^2 = 
{0, 1}. Notice that this channel does not satisfy the condition 
of the deterministic interference channel in [6 |. Obviously, the 
Markov chain ( fT3l l holds. Moreover, 

I{X 1 ;Y 1 \X 2 )=H(Y 1 \X 2 )=p(x 2 = l)#(Xi), 

I{X l -Y 2 \X 2 ) = H{Y 2 \X 2 ) =H(X{). 

Therefore, 

I(X 1 ;Y 1 \X 2 ) <I{Xv,Y 2 \X 2 ), 

for all possible input product distributions on X\ x X2- 
Therefore, this is a DMIC with mixed interference. Apply 
Theorem [3] we compute the sum capacity is 

C 3um = max [min(J(X 1 X 2 ;y 2 ),/(Xi;F 1 ) + /(X 2 ;y 2 |X 1 ))] 

p(x 1 )p(x 2 ) 

= 1. 

Given that (1,0) and (0, 1) are both trivially achievable, the 
above sum capacity leads to the capacity region for this DMIC 
tobe{(iJi,i2a): J Bi+i?2<l}. 



In this paper, we derived the sum capacity for the DMZICs 
with weak interference where weak interference is defined 
using a Markov condition. Similar techniques are then applied 
to derive the sum capacity for DMIC with mixed interference. 
Both results are analogous to the sum capacity results for the 
corresponding Gaussian channel, both in the expression of the 
capacity and in the encoding schemes that achieve the capacity. 

The weak interference condition is defined using a Markov 
chain, as opposed to that using the mutual information in- 
equality. While it appears to be somewhat restrictive, it is not 
known whether the definition using the mutual information 
condition will lead to the same sum capacity result. 
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